Thought Question 


At a doctor's visit you are told that you have tested 
positive for a rare kidney disease. The doctor tells you 
that the test is very accurate and that more than 99% of 
people with the disease test positive. He suggests you 
immediately begin a course of treatment, which should 
cure the disease but has some serious side-effects. 
Before agreeing to the treatment, what additional 
information do you want to get from the doctor? 


Base rates: Kidney example 



Disease 

No disease 



Test 

Positive 

99 

? 

? 

positive test = 
disease? 

99/??? = (??) 

Test 

Negative 

1 

? 

? 



100 

? 




disease= 
positive test? 
99/100 (99%) 





Need to worry about test? Need to know base rate and 
false alarm rate. 




Base rates: Kidney example 



Disease 

No disease 



Test 

Positive 

99 

1 

100 

positive test = 
disease? 

99/100= (99%) 

Test 

Negative 

1 

99 

100 



100 

100 


/ 


disease= 
positive test? 
99/100 ( 99 %) 


/ 

f 


False Alarm Rate = 1%; Basypate: 50% 

Need to worry about test? YES. 


Base rates: Kidney example 



Disease 

No disease 



Test 

Positive 

99 

990 

1089 

positive test = 
disease? 

99/1089= ( 9 %) 

Test 

Negative 

1 

8910 

8911 



100 

9,900 


/ 


disease= 
positive test? 
99/100 ( 99 %) 



l 


False Alarm Rate = 1 %; Base rate: 1 

Need to worry about test? only a little... 







Base rates: Kidney example 



Disease 

No disease 



Test 

Positive 

99 

0 

99 

positive test = 
disease? 

99/99= ( 100 %) 

Test 

Negative 

1 

9900 

9901 

/ 


100 

9,900 


/ 


disease= 
positive test? 
99/100 ( 99 %) 



/ 


False Alarm Rate = 0%; Base rate: 1 ^ 

Need to worry about test? only a little... 


Base rates: Kidney example 



Disease 

No disease 



Test 

Positive 

99 

50 

149 

positive test = 
disease? 

99/149= (66%) 

Test 

Negative 

1 

50 

151 



100 

100 


/ 


disease= 
positive test? 
99/100 ( 99 %) 


/ 

f 


False Alarm Rate = 50%; Basroate: 50% 

Need to worry about test? MA\T5E 






Problem Solving 
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What is a problem? 

Dear Abby: 

I have no shortage of (Facebook) friends, and new ones come in 
regularly. But some of the online invitations for friendship come 
from people I don’t know. Some are from folks in my field, so 
there’s some kinship and common bond even though we haven’t 
formally met. Some are from college students, studying the field 
that I’m in (new media, grassroots media). Some seem to have no 
connection to me whatsoever, so those get treated like spam and 
the invitations rejected. But what’s the etiquette here? Should I 
“befriend” complete strangers if we’ve got something in common? 
Should I limit my Facebook friends to people I’ve met? What to do, 
Abby? 


"ripped from the headlines" 08-2007 
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The parts of a problem 


What is a problem? 

A problem has: 
o Givens 
o A goal 
o Obstacles 
o Operators 


9 


What is a problem? 

A problem has: _ 

o Givens: 

The initial conditions, objects, and information 
_ available. _ 

o A Goal 
o Obstacles 
o Operators 
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What is a problem? 

A problem has: 

o Givens _ 

o A Goal: 

The desired outcome or information. 

(No goal? What's the point?) 

o Obstacles 
o Operators 


What is a problem? 

A problem has: 
o Givens 

_Q_ A God! _ 

o Obstacles 

What is between givens and goal. 

_ (Without obstacles, you don't have a problem to solve...) 


O 


Operators 





What is a problem? 


A problem has: 
o Givens 
o A Goal 

o Obstacles _ 

o Operators 

Means of transforming the conditions. 

(Without these, you can't solve the problem...) 


Types of problems 


well-defined problems 
and 

poorly defined (ill-defined) problems 




Types of problems 


well-defined problems 

- components of the problem are clearly specified 

examples: games, math 

poorly defined (ill-defined) problems 

- uncertainty in givens, obstacles, operators, even 

examples: health care decisions, managing friendships 


A Classic Well-defined Problem 



The Tower of Hanoi Problem 

Move stack to far right peg, one disc at a time 
A disc cannot be placed on a smaller disc 





Let’s try it! 

o http://www.mazeworks.com/hanoi/index.htm 
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Fun facts: 


The Tower of Hanoi (sometimes referred to as the Tower of Brahma or 
the End of the World Puzzle) was invented by the French 
mathematician, Edouard Lucas, in 1883. He was inspired by a legend 
that tells of a Hindu temple where the pyramid puzzle might have been 
used for the mental discipline of young priests. Legend says that at the 
beginning of time the priests in the temple were given a stack of 64 
gold disks, each one a little smaller than the one beneath it. Their 
assignment was to transfer the 64 disks from one of the three poles to 
another, with one important provision that a large disk could never be 
placed on top of a smaller one. The priests worked very efficiently, day 
and night. When they finished their work, the myth said, the temple 
would crumble into dust and the world would vanish. 
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Why are we still here then? 


The number of separate transfers of single disks 
the priests must make to transfer the tower is 2 to 
the 64th minus 1, or 18,446,744,073,709,551,615 
moves! If the priests worked day and night, 
making one move every second it would take 
slightly more than 580 billion years to accomplish 
the job! 
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A Classic Problem 

o What are the givens? 
o Three disks of different sizes 
o Three poles 

o Initial state: three disks all stacked in order of 
size (smallest on top) on the left-most pole 


state : current description of the elements of the problem 
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A Classic Problem 


o What is the goal? 

o Final state: Get all three disks stacked in 
order of size (smallest on top) on right-most 
pole. 


A Classic Problem 

o What are the obstacles? (what is the 
difference between the current state and 
the goal) 

o We are on the wrong pole! 



A Classic Problem 


o What are the operators (“legal moves”)? 
o Can move disks from one pole to another. 

o RESTRICTIONS: 

o can move only one disk at a time 
o can only move the top disk 

o can only put disk onto empty pole or onto one 
having a larger disk 


o As you apply the operators, you create 
intermediate states of the problem. 


Problem space 

o In well-defined problems, we know: 
o what the initial state is 
o what the final state should be 
o what all the allowed moves are 

o Therefore: in principle, we can make a 
map, called a problem space, that shows 
all the possible moves and trajectories ... 
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Problem space 

o With a problem space worked out, you 
can determine the most efficient mapping 
from the initial state to the goal state. 

o For the Tower of Hanoi, can do it in seven 
moves. 

o Can have an objective measure of problem 
solving efficiency and of the value of any 
given move. 





Studying problem solving 


verbal protocols : 

subjects are asked to "think aloud" during 
the course of solving a problem 

intermediate products : 

analyze the steps the subjects take when 
working towards the goal 

computer simulations : 

program a computer to follow possible 
routes to a problem solution 
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The Newell and Simon approach 

Problem Solving as Representation and Search: 

information processing approach to problem solving 

- Have resource limitations 

STM capacity 

Time to access LTM 

Time to store info into LTM 

- Processing is serial 

- Representations are discrete 

Goal, operators, etc. 
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(1) Representation: 

Information processing system acts on the 
task environment (the problem in the "real 
world") to create a problem space 


Task Environment 



Problem Space 


NOTE: may be incomplete 
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(2) Search: 

Information processing system uses operators 
to move through the problem space, 
"searching" for the next move 


State 1 



Search through 
problem space 


NOTE: may be inefficient 


State 2 
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Two “kinds” of search 

Algorithmic: systematic procedure that is guaranteed 
to lead to correct solution (all possibilities are 
considered) 

+ = guaranteed solution (complete search) 

- = time consuming, often too many possibilities 

Heuristic: "shortcut" method of guiding search so 
that the solution is likely 

+ = easier to process 

- = no guarantee of a solution 
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Algorithms 


o Good algorithm: 

o Approach to a problem that solves the 
problem each and every time 

o Not always the most efficient 
o Something that a computer could do for you 
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Example Algorithm 


o Example algorithm for the tower of Hanoi 

o (this is something you could implement in a 
computer) 

o Step 1 - Move n-disk tower from source to 
destination via resting place 

o Step 2 - Move n-1 disk tower from source to 
resting place 

o Step 3 - Move 1 disk tower from source to 
destination 

o Step 4 - Move n-1 disk tower from resting place 
to destination 
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Example 


o The Rubicks cube 

o well-defined problem: one solution 

o algorithm is series of moves to apply to get to 
the solution from starting state 

Before The Move After 

the middle layer turns! the middle layer turns! 
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Some heuristics 

Simple search 

o assess current state and possible next states 
o choose one that moves you closest to the goal 
o "Hill climbing" 

PROBLEM? 

Sometimes temporarily moving away from goal is the 


best strategy ^^ 



“local maximum” 
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An Example 


The Missionaries and Cannibals Problem: 

You have to transport three missionaries and three 
cannibals across a river. You have at your disposal a 
small boat that can only carry two creatures. The 
problem is that if the cannibals ever outnumber the 
missionaries on one of the riverbanks ... well you can 
guess what happens. 
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The Missionaries and Cannibal Problem: 


Initial State: 


Goal State: 
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o 


Operators: boat that moves two people across 
o Restrictions: 


o one person must be in boat to move boat 

o can't have more cannibals than missionaries on the 
same side of the river (including whoever is in boat 
on that side) 


Let’s try it! 


http://www.plastelina.net/qames/qame2.html 



[>o 


Why is this problem 


o And, more specifically, why can’t a simple 
search (“hill climbing”) heuristic solve it? 


The Problem Space 



lc = one cannibal moves across the river 
2m = two missionaries move across the river 
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Choice point: must go BACK 

o simple hill-climbing (always move towards 
goal) doesn’t work.... 


More heuristics 


Working backwards 
o start from goal state 

o figure out what move right before goal should be 
o repeat 
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Working backwards 


o Joe gives Nick and Tom as many peanuts 
as each already has. Then Nick gives Joe 
and Tom as many peanuts as each of 
them then has. Finally, Tom gives Nick 
and Joe as many peanuts as each has. If 
at the end each has sixteen peanuts, how 
many peanuts did each have at the 
beginning? 


Working backwards 

o Working backwards, we can start with the 
end result and analyze each step: 

o “If at the end each has sixteen peanuts” 

o Joe Nick Tom 

o Peanuts at end: 16 16 16 
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Working backwards 


o Joe gives Nick and Tom as many peanuts 
as each already has. Then Nick gives Joe 
and Tom as many peanuts as each of 
them then has. Finally, Tom gives Nick 
and Joe as many peanuts as each has. If 
at the end each has sixteen peanuts, how 
many peanuts did each have at the 
beginning? 


Working backwards 

o “Tom gives Nick and Joe as many 
peanuts as each has” 

o Joe Nick Tom 

o Peanuts at end: 16 16 16 

o Previous round: 8 8 32 
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Working backwards 


o Joe gives Nick and Tom as many peanuts 
as each already has. Then Nick gives Joe 
and Tom as many peanuts as each of 
them then has. Finally, Tom gives Nick 
and Joe as many peanuts as each has. If 
at the end each has sixteen peanuts, how 
many peanuts did each have at the 
beginning? 


Working backwards 


o “Nick gives Joe and Tom as many 
peanuts as each of them then has” 


Joe 


Nick 

Tom 

Peanuts at end: 

16 

16 

16 

Previous round: 

8 

8 

32 

Previous round: 

4 

28 

16 
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Working backwards 


o Joe gives Nick and Tom as many peanuts 
as each already has. Then Nick gives Joe 
and Tom as many peanuts as each of 
them then has. Finally, Tom gives Nick 
and Joe as many peanuts as each has. If 
at the end each has sixteen peanuts, how 
many peanuts did each have at the 
beginning? 


Working backwards 


o “Joe gives Nick and Tom as many 
peanuts as each already has.” 



Joe 

Nick 

Tom 

Peanuts at end: 

16 

16 

16 

Previous round: 

8 

8 

32 

Previous round: 

4 

28 

16 

Peanuts at start: 

26 

14 

8 
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More heuristics 


Means-ends analysis 

o assess current state with regards to goal 
o identify biggest difference 
o make that your immediate goal ("subgoal") 
o now either: 

o select operator for subgoal 
o OR 

o repeat above 

o General Problem Solver: computer program that 
uses means-ends analysis to solve problems 


Means-ends Example 

o Problem: Get from home (NJ) to granny (LA) 
o Difference-operator table 

difference 

(between start 
and goal) 


operator 



airplane 

train 

car 

bus 

walk 

+1000 

miles 

X 





100 -1000 


X 

X 



1 -100 



X 

X 


< 1 mile 





X 


at 

airport 

at 

station 

in car 

at bus 
stop 

none 


precondition 




Means-ends Example 


o Problem: Get from NJ to LA 
o Difference-operator table 


difference 

(between start 
and goal) 


operator 



airplane 

train 

car 

bus 

walk 

+1000 

miles 

X 





100 -1000 


X 

X 



1 -100 



X 

X 


< 1 mile 





X 


at 

airport 

at 

station 

in car 

at bus 
stop 

none 


precondition 


Means-ends Example 

o Problem: Get from NJ to LA 
o Difference-operator table 

difference 

(between start 
and goal) 


operator 



airplane 

train 

car 

bus 

walk 

+1000 

miles 

X 





100 -1000 


X 

X 



1 -100 



X 

X 


< 1 mile 





X 


at 

airport 

at 

station 

in car 

at bus 
stop 

none 


precondition 





Means- 
End — 




airplane 

train 

car 

bus 

walk 

+1000 

miles 

X 





100-1000 


X 

X 



1 -100 



X 

X 


< 1 mile 





X 


at 

airport 

at 

station 

in car 

at bus 
stop 

none 


+1000 miles 
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Summary of Search 


o For well-defined problems, need to move 
through problem space by applying operators. 

o At each step, must search to find best operator 
to apply next. 

o Can do it systematically (algorithmic), but may require 
too much time, too many resources, 
o Can use a heuristic (though may fail): 
o simple search 
o working backwards 
o means-ends 
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Representation 


Also have to think about how to represent problem: 

Missing, incorrect, or biased problem representation 
impede problem solving ability. 

- problem space can include irrelevant parts or 

exclude relevant parts 

- operators can be missing or difficult to apply 


Nine Dot Problem: 




Nine-dot problem 



o Two more solutions.... 




Individual differences 


o What predicts success in problem 
solving? 



Individual differences 


o Tower of Hanoi 

o Performance is thought to reflect 
o Ability to plan ahead to solve a problem 
o Frontal lobe function 

o Performance is not correlated with 
o Verbal IQ 

o Inhibition control (ability to inhibit a prepotent response, 
e.g., Stroop Task) 

o Performance does improve with 
o age 

o Performance is impaired in: 

o autism, Asperger syndrome, intellectual disabilities 


Thought Question 


In the missionaries and cannibals problem, it is generally the 
case that two creatures are brought over and one is then 
brought back, yielding a net increase in creatures on the 
“goal” side. In one critical step, however, two creatures are 
brought back in the boat. For each of the following search 
strategies, say whether a solution to this problem is: 

(1) guaranteed, (2) possible but not guaranteed, 

(3) impossible 

a. algorithmic 

b. hill climbing (simple search) 

c. working backwards 

d. means-ends 
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